Variance Reduction for Monte Carlo Implementation of Adaptive Sensor Management
نویسندگان
چکیده
Adaptive sensor management (scheduling) is usually formulated as a finite horizon POMDP and implemented using sequential Monte Carlo. In Monte Carlo, variance reduction is important for the reliable performance of the sensor scheduler. In this paper, we propose a Control Variate method for variance reduction when the sensor is scheduled using the Kullbach Leibler criterion.
منابع مشابه
Planar and SPECT Monte Carlo acceleration using a variance reduction technique in I131 imaging
Background: Various variance reduction techniques such as forced detection (FD) have been implemented in Monte Carlo (MC) simulation of nuclear medicine in an effort to decrease the simulation time while keeping accuracy. However most of these techniques still result in very long MC simulation times for being implemented into routine use. Materials and Methods: Convolution-based force...
متن کاملAdaptive Importance Sampling for Uniformly Recurrent Markov Chains
Importance sampling is a variance reduction technique for efficient estimation of rare-event probabilities by Monte Carlo. In standard importance sampling schemes, the system is simulated using an a priori fixed change of measure suggested by a large deviation lower bound analysis. Recent work, however, has suggested that such schemes do not work well in many situations. In this paper, we consi...
متن کاملAdaptive Monte Carlo Variance Reduction with Two-time-scale Stochastic Approximation
Combined control variates and importance sampling variance reduction and its two-fold optimality are investigated. Two-time-scale stochastic approximation algorithm is applied in parameter search for the combination and almost sure convergence of the algorithm to the unique optimum is proved. The parameter search procedure is further incorporated into adaptive Monte Carlo simulation, and its la...
متن کاملAn Efficiency Studying of an Ion Chamber Simulation Using Vriance Reduction Techniques with EGSnrc
Background: Radiotherapy is an important technique of cancer treatment using ionizing radiation. The determination of total dose in reference conditions is an important contribution to uncertainty that could achieve 2%. The source of this uncertainty comes from cavity theory that relates the in-air cavity dose and the dose to water. These correction factors are determined from Monte Carlo calcu...
متن کاملA framework for adaptive Monte Carlo procedures
Adaptive Monte Carlo methods are recent variance reduction techniques. In this work, we propose a mathematical setting which greatly relaxes the assumptions needed by for the adaptive importance sampling techniques presented in [24, 23, 1, 2]. We establish the convergence and asymptotic normality of the adaptive Monte Carlo estimator under local assumptions which are easily verifiable in practi...
متن کامل